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In previous studies, researchers have attemoted to 

rvj 

^ ganirate learning hierarchies using task analysis based 

^ pri:narily on episteraological considerations (Gagne & Paradise, 

^ ^ 1961; Gagne, 1962; Cox & Graham, 1966; Uprichard, 1970; Okey 

h Gagne, 1970; xiarke, 1971; Ribar., 1971; Phillips & Kane, 
1973; Miller S Phillips, 1975). Studies of this type con- 
ducted in the early sixties provide substantial evidence to 
support the hierarchical structure of knowledge (Gagne & 
Paradise, 1961; Gagne & Brown, 1961; Gagne, 1962, 1963; Gagne, 
Mayor, Garstens & Paradise, 1962; Gagne & Sta/f, 1965). An 
examination of results from recent studies (Neidermeyer , 
:;rov;n & Sulzen, 1969; Brown, 1970; Phillips & Kane, 1973; 
Callahan & Robinson, 1973) suggests that optimal learning 
sequences can be developed by sequencing instructional materi- 
als according to validated learning hierarchies. However, 
both Gagne (1968) and Pyatte (1969) have pointed out that the 
determination of an optimal or hierarchical sequence of sub- 
tasks from simplest to most complex is not easily achieved. 

Numerous hierarchy validation techniques have appeared 
in the literature. Critical analyses of the efficacy of 
^ these techniques are also reported (Resnick & Wang, 1969; 



% Eisenberg & Walbesser, 1971; White, 1973/ White, 1974a, 1974b; 

O Phillips, 1971, 1Q74) . Many of these techniques ore concerned 

o 



FRIC 



2 



with the analysis of data collected on hypothesized hierar- 
chies. While there is considerable room for improvement, 
techniques such as the Walbesser Method (Walbesser, 1968) 
and Pattern Analysis (Rimoldi & Grib, 1960) have been used ' 
effectively in validating hypothesized hierarchies (Ilarke, 
1971; Phillips & Kane, 1973; Miller & Phillips, 1975). 

The investigators in the present study were concerned 
with the generation and validation of ^n hypothesized learn- 
ing hierarchy. More specifically, the purposes of the study 
v;ere: (1) to develop a learning hierarchy for rational 
number subtraction using the intraconcept analysis tochniquo 
(Uprichard and Phi -lips, 1975), and (2)" to test the validity 
of the hypothesized hierarchy using the Walbesser Technique 
and Pattern Analysis. The objective in doing an intraconcept 
analysis is to generate a series of tasks, each of which 
represent an operationalized level of a given concept. This 
technique differs fror.i the more widely used task analysis 
model in that consideration is given to both psychological 
and content (discipline) factors in developing and hierar- 
chically ordering tasks. Because of this, the authenticity 
of many tasks generated using the intraconcept analysis tech- 
nique nay be questioned by content area specialists. T!ie 
present study, the second in series, v;as conducted in hopes 
of shedding further light on the epistemological-p-ychologicr^l 
balance needed in developing effici-nt or optimal instruc- 
tional sequences in riath^^^matxcs. ^ 



^Jui.b.-i'^l'irH^fo^..^^'''^'-''' "'^"^ Intraconcept Analysis of fntionoi 
waabci Addition" was presented at /iHHA 1975. 



PROCEDUnL 

Jnjvelopment ot Hierarchy 

The intraconcept analysis strategy used to analyze the 
subtraction of rationals in fraction form was as follows: 

a) ProbJems were divided into tv/o levels - like derr.on- 
inators, and unlike denominators. Classes within 
each level were identified by the nature of (prime 
and composite) and relationship between (mur iple 
or not) denominators of the two rationals subtracted. 
The classes, in their hypothesized order of diffi- 
culty, v;ere: 
Like Denominators 

A. Composites. (2/4 - 1/4 = ' ) 

B. Priifies. (2/5 - 1/5 = ) 

Unlike Demominators 

C. Composites - one composite multiple of otH^r. 

( 1/4 - 1/8 = ) 

D. Prime, composite - composite a multiple of prime. 

(1/5 - 1/10 = ) 

S. Primes. (1/5 - 1/7 = ) 

F. Prime, composite - composite not multiple of 
prime. ( 1/5 1/9 = ) 

G. Composites - not multiples. (1/6 - 1/8 = ) 
b) Within each denominator class an attempt was made 

to generate five renaming categories. The renaming 
categories were operationally defined in terms of 
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renaniings required in the differanca and/or sun 
(minun jnd) . ^ 

I. Difference - proper fraction in sinplest form 
v;ithout renaming.. (2/4 - 1/4 = 1/4) 

II. Difference - proper fraction renamed to zero. 
(1/4 - 1/4 = 0/4 = 0) 

m. Difference - proper fraction renamed to simplest 
form. (3/4 - 1/4 = 2/4 = 1/2) 

IV. Renaming in sum, difference - proper fraction in" 
simplest form v;ithout renaming. (1 1/4 - 2/4 = 

"5/4 - 2/4 = 3/4) 

V. Renaming in su.n, difference - proper fraction 
rena.-ied to simplest form. (1 1/4 - 3/4 = 5/4 - 3/4 = 
2/4 = 1/2} 

c. Two tasks involving mixed numerals (whole numbers 
greater than one and less than ten) were associated 
with each renaixiing category within a denominator f 
class. A renaming categoiy and its two related tasks 
is presented below: 

Renaming Category I Task # 1 Task #2 

2/4-1/4 = 3 2/4-11/4 = 3 2/4-1/4 = 

d. Mine additional subtraction problems with v;hole 
number sums x^ere included in the hierarchy. These 
problems are: 
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Five renaming categories do not exist in some denominator 
classes . 
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1 - 1/4 = 3/4 3 - 1 1/4 = 2 4/4 - 1 1/4 = 1 3/4 

3 - 1/4 = 2 4/4 - 1/4 = 2 3/4 

1 - 2/4 = 2/4 -. 1/2 3 - 1 2/4 = 2 4/4 - 1 2/4 = 1 2/4 = 1 1/2 

3 - 2/4 = 2 4/4 - 2/4 = 2 2/4 = 2 1/2 

1 - 2/3 = 1/3 3 - 1 2/3 = 2 3/3 - 1 2/3 = 1 1/3 

Analysis of Hierarchy 

The above procedures yielded ninety-six specific tasks. 
In order to hold testing to a manageable size, soma tasks 
within classes were collapsed. The final hierarchy consisted 
of 47 tasks. Based upon the hypothesized ordering of the 
subordinate tasks, a test was constructed to assess mastery 
at each level in the hierarchy. "Pass" was defined as correct 
difference expressed in simplest form. For ease ii computa- 
tion the tasks appeared in vertical, form. The test v;as ad- 
r,iinistered to 200 students in grades 4 through 8 in order to 
obtain a wide range of ability levels. The majority of the 
Ss were in grades 5 and 6. Subjects who passed or failed 
all 47 items were excluded from the study since inferences 
aboat the order of items cannot be based on responses from 
these students (Phillips & Kane, 1975). The resulting sample 
contained 174 Ss. 

The patterns of responses for each transfer in the hier- 
archy were analyzed using both the Walbesser Technique 
(Ualbesser, 1968) and Pattern Analysis (Rimoldi & Grib, 1960). 
The Walbesser Technique is based on the 2X2 contingency 
table of ypass-fail responses (Figure 1) . 



Item I 



fail (~) pass (+) 





pass 


(+) 


-+ 


■H- 


Itan-t 2 












fail 


(-) 




+- 



Figure 1. Contingency Table 

Using the frequency of students falling in each cell above, 
the following three ratios were computed for every possible 
relationship in the hierarchy (i.e. level 1 with 2, 1 with 
3, ... 1 with 47; 2 with 3, 2 with 4, ... 2 with 47, etc.). 

(1) Consistency Ratio = (++) 

(++) + (+-) 

The value of this ratio is a measure of how con- 
sistent the data are with the hypothesized depen- 
dency. 

(2) Adequacy Ratio = (++) 

(++) + (__) 

The value of this ratio is a measure of the ade- 
quacy of the identified levels. 

(3) Completeness Ratio = (++) 

{++) + (~) 

The value of this ratio is a measure of the effec- 
tiveness of instruction. 
The level of acceptability used for each of these ratios was 
that determined by Phillips (1971) instead of those proposed 
by ■Jalbosscr since no instructional sequences were involved. 
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These levels are: (1) Consistency Ratio (2) Adequacy 

natio .70 r (3) Conipleten2ss Ratio .SO. 

The pattern analysis technique v/as used to analyze the 
responses fov the coraplete hierarchy on a subject by subject 
basis* The index of agreement given by the pattern analysis 
indicates the cunount of agree^aent or correlation J^etween- tv;o 
patterns. In this case, the index of agreement indie \tes 
C.13 agreeraent between the observed and expected patterns. If 
the tasks were truly hierarchical, where each subtask was a 
necessary prerequisite to the next, once a learner failed a 
given level he would be expected to fail all subsequent 
levels. Thus, the expected pattern was defined as one v;here 
no correct responses followed an incorrect response. 

RESULTS 

The initial hypothesized hierarchy developed using an 
intraconcept analysis is given in Table 1* A computer program 
based on the Walbesser Technique was used to give the pass-fail 



Insert Table 1 About Here 



response patterns between all relat. onships. That is, item 
1 was paired with all 47 items; item 2 with all items; etc.; 
until all possible pairs of items were onsidered. 

In. order to analyze the hypothesized hierarchical sequence, 
the consistency, adequacy, and completeness ratios for each 
relationship within the hierarchy v;ero examined* The ordering 
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which yielded the best fit to the data is shown in Table 2. 

Insert Table 2 About Here 

The pattern of responses c' tained from the hypothesized 
ordering of subordinate tasks yielded an index of agreement 
of .53. After final revision, the empirical sequence yielded 
an index of agreement of .75 which indicates a higher agree- 
ment between the expected and observed response patterns. No 
statistical test of significance for the index of agreement 
has been developed. 

The internal consistency of the test based on the initial 
hierarchy was determined using the Kuder- Richardson Form.ula 20 
(IJunnally, 1967). The value of this coefficient was .96. 
The pattern of responses for the empirical sequence was 
analyzed to determine if the ordering exhibited a hierarchical 
structure based on item difficulty. Item difficulty of each 
task in the ordered sequence is given in Table 3. Although 

Insert Table 3 About Here 

there would be some discrepancies between a hierarchical' 
sequence based on item difficulty and the ordered sequence 
determined, the general pattern of item difficulty of the 
latter is acceptable. Further, item difficulty alone is not 
considered an adequate technique for determining hierarchical 
relationships (Phillips, 1971). 

9 



DISCUSSION AND IMPLICATIOIiS 

An exaniinaticn of the data in Table 2 (Walbesser ratios) 
indicates that with few exceptions task comparisons within 
the empirically determined hierarchy meet specified criteria 
on two of the three ratios. The consistency ratio was met 
in 34 of 46 coraparisons , the Adequacy Ratio in 45 of 46, and 
the Compleceness Ratio in 43 of 46. It should be noted that 
of the eleven comparisons not meeting the criteria level for 
the Consistency Ratio, five missed the criteria by .02 or less 
The index of agreement for the hypothesized forty-seven task 
hierarchy was .63. After the tasks were rearranged in an 
empirical hierarchy based on Walbesser ratios the index of 
agreement v;as .75. 

The empirically determined sequence is presented in 
Table 4. An examination of the sequence tends to support- 
the following implications for teaching youngsters the sub- 
traction of rationals in fraction form. 



Insert Table 4 About Here 



1. In subtracting rational numbers in fractional form, 
finding lerst common denominators is not as diffi- 
cuic for learners as the renaming (s) (sum and/or 
difference) required. 

2. Within renaming categories I and II, tasks involvin( 
like denominators (3/4 - 2/4 = ; 3 1/2 - 2 2 ^4 = 

10 
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3/4 - 3/4 = ; 3 3/4 - 3/4 = ) should be 

taught before proceding to tasks involving unlike 

denominators (1/2 - 1/3 = ; 3 1/2 -2 2/4= 

4/8 - 2/4 = ; 3 4/8 - 2/4 = ) . 

Uithin renaming categories I and II, tasks involving 

unlike denominators (1/3 - 1/4 = ; 4/8 - 2/4 = ) 

should be taught before those involving like denomin- 
ators in renaming category III (3/6 - 1/6 = ). 

Within renaming category III, tasks involving unlike 

denominators (5/12 - 1/6 = ) should be taught 

before those involving like denominators in renaming 

categories IV and V ( 1 1/4 - 2/4 = ; 11/6-3/6 = 

) . 

Within a renaming category, subtraction of two 
mixed numerals with whole number parts greater than 

one (61/6-3 2/4 = ) should be taught before, 

subtraction involving one mixed numeral (7 3/6 - 3/4 = 

) . 

Tasks involving whole number sums greater than one 

(5 - 1/6 = ) should be taught after work is 

completed with like denominators in renaming categories 

IV and V ( 1 1/4 - 2/4 = ; 1 1/7 2/7 = ; 

1 1/6 - 3/6 = ) . 

Tasks involving whole number sums (greater than one) 
requiring renaming in the difference (6-1 2/10 = 
. ? 5 - 2/4 = ) should be taught before those 
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v/hich requjlre no such renaming (3-11/4 = 
4 - 1/6 = ) . 

8. Within renaming categories 1, II, m the hypothe- 
"sized ordering of unlike denominator classes (C, 

D, E, F, G) was verified. Ilowevei: no pattern emerges 
for sequencing denominator classes in renaming 
categories IV and V. ^. 

9. Sequencing of tasks in renaming categories IV and V 
is difficult. This may be a result of renaming 
interactions between sums and differences. 

In general, the results of this, study, though limited 
to the subtraction of rational numbers in fraction foi-m, support 
the notion that both epistemological and psychological factors 
be considered when developing teaching sequences in mathematics. 
Sonie of the implications above would not necessarily be de- 
rived from logical analysis alone. Also, in interpreting the 
results of this study one must be conscientious of the limita- 
tions of indirect, validation procedures. For example, con- 
founding variables such as prior educational experience of 
subjects and errors of measurement must be considered. 
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TABIE 1 

Initial Hypothesized ilierarchy 



1. 3/4 - 2/4 -■ 

2. 2/3 - 1/3 = 

3. 5/8 - 5/8 = 

4. 2/5 - 2/5 = 

5. 3/6 - 1/6 = 

6. 3 2/6-2 1/6 = 

7. 3 4/7-2 3/7 = 

8. 1 - 1/3 = 

9. 1 - 2/6 = _^ 

10. 4 - 1/6 = 

11. 5 - 2/4 = 

12. 3-1 1/4 = 

13. 6-1 2/10 = 

14. 1 1/4 - 2/4 = 

15. 1 1/7 - 2/7 = 

16. 1 1/6 - 3/6 = 

17. 1/4 - 1/8 = 

18. 1/3 - 1/9 = 

19. 1/2 - 1/3 = 

20. 1/3 - 1/8 = 

21. 1/6 - 1/8 = 

22. 1/8 - 2/16 = 

23. 4A4 - 2/7 = 

24. 5/30 - 4/8 = 



25. 5A2 - 1/6 = 

26. 2/5 - 2/10 = 

27. 6/9 - 1/2 = _ 

28. 3/4 - 3/6 = _ 

29. 3 1/8-2 1/16 

30. 6 3/9-3 1/3 

31. 8 4/8-2 1/3 

32. 4 1/6 - 1/12 = 

33. 3 1/5 - 2/10 = 

34. 5 3/5 - 3/9 = 

35. 1 1/8 - 1/4 = 

36. 1 1/9 - 1/3 = 

37. 1 1/5 - 2/3 = 

38. 1 2/5 - 4/9 = 

39. 1 1/8 - 1/6 = 

40. 1 3/18 - 3/9 = 

41. 1 1/5 - 4/10 = 

42. 1 6/9 - 4/5 = _ 

43. 1 2/6 - 6/9 = _ 

44. 4 1/5-2 2/7 = 

45. 6 1/G - 3 2/4 = 

46. 2 1/3 - 2/5 = _ 

47. 7 3/6 - 3/4 = 



TABLE 2 

V7albesser's Ratios For Tne Droirical Ordering (li = 



174) 



Level 



Ccnsistency 



Meguacy 



Ccrpleteness 
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1- 2 

2- 3 

3- 4 

4- 6 

6- 7 

7- 8 

8- 17 

17- 18 

18- 19 

19- 20 

20- 21 

21- 22 

22- 23 

23- 24 

24- 29 

29- 30 

30- 32 

32- 33 

33- 5 

5- 25 

25- 26 

26- 27 

27- 28 

28- 14 

14- 15 

15- 16 

16- 35 

35- 36 

36- 37 

37- 9 

9- 12 

12- 10 

10- 13 

13- 11 

11- 31 

31- 39 
39-41 
4L-43 

43- 44 

44- 38 

38- 45 

45- 46 

4b-47 

47-40 

"13-34 
34-42 



.99 
.-99 
1.00 
.97 
.94 
.98 
.90 
.97 
.95 
1.00 
.97 
.94 
.99 
.97 
.90 
.94 
.94 
.96 
.83 
.89 
.84 
.89 
.83 
.84 
.92 
.95 
.89 
.93 
.89 
.83 
.88 
.95 
.94 
.89 
.80 
.84 
.83 
.89 
.69 
.83 
.86 
.77 
.90 
.70 

■M 
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.99 
.97 
1.00 
.91 
.99 
.87 
.97 
.95 
1.00 
.96 
.94 
.92 
.97 
.94 
.90 
.93 
.94 
.S2 
.85 
.85 
.87 
.83 
.92 
.84 
.94 
.S9 
.90 
.92 
.87 
.84 
.71 
.75 
.72 
.75 
.79 
.79 
.85 
.72 
.79 
.78 
.77 
.88 
.71 
.72 

.76 
.44 



1.00 

1.00 
.97 
.99 
.96 
.97 
.95 
.55 
.95 
.95 
.94 
.93 
.88 
.87 
.90 
.86 
.86 
.83 
.86' 
.81 
.81 
.79 
.76 
.81 
,78 
.76 
.75 
.74 

.74 
.74 

.66 

.67 

.66 

.62 

.69 

.64 

.62 

.55 

.52 

.59 

.53 

.58 

.55 

.46 

.36 

•23 



TABLE 3 

Item Difficulty - Bn^irical Hierarchy (47 Tasks) 



Task 



Difficulty 



Task 



Difficulty 



1 (Sijtplest) 


1.00 


14 


.74 


2 


1.00 


15 


.75 


3 


.98 


16 


.70 


4 


.98 


35 


.72 


6 


.93 


36 


.71 


7 


.97 


37 


.70 


8 


.85 


9 


.69 


.17 


.93 


12 


.53 


18 


.93 


10 


.72 


19 


.96 


13 


.54 


20 


.93 


11 


.69 


21 


.91 


t 

31 


.62 


22 


.88 


3S 


.61 


23 


.87 


41 


.62 


24 


.85 


43 


.43 


29 


.83 


44 


.58 


30 


.81 


38 


.57 


32 


.80 


45 


.55 


33 


.81 


46 


.61 


5 


.78 


47 


.48 


25 


.79 


40 


.43 


2G 


.78 


34 


.35 


27 


.72 


42 Ctost Difficult) 


.31 


28 


.75 


15 





anpirical Hierarchy of Tasks 



1* 


3/4 - 2/4 = (Simplest) 


14. 


1 1/4 - 2/4 = 


2. 


2/3 - 1/3 = 


15. 


11/7-2/7 = 


3. 


5/8 - 5/8 = 


16. 


1 1/6 - 3/6 = 


4. 


2/5 - 2 /5 = 


35. 


1 1/8 - 1/4 = 


6. 


3 2/6-2 1/6 = 


36. 


1 1/9 - 1/3 = 


7. 


3 4/7 - 2 3/7 = 


37. 


1 1/5 - 2/3 = 


8. 


1 - 3/8 = 


9. 


1 - 2/6 = 


17. 


1/4 - 1/8 = 


12. 


3 r 1 1/4 = 


18. 


1/3 - 1/9 = 


10. 


4 - 1/6 = 


19. 


1/2 - 1/3 = 


13. 


6-1 2/10 = 


20. 


1/3 - 1/8 = 


11. 


5^2/4 = 


21. 


1/6 - 1/8 = 


31. 


8 4/8-2 1/3 = 


22. 


1/8 - 2/16 = •• 


39. 


1 1/8 - 1/6 = 


23. 


4/14 - 2/7 = 


41. 


1 1/5 - 4/10 = 


24. 


5/10 - 4/8 = 


43. 


1 2/6 - 6/9 = 


29. 


3 1/8-2 1/16 = 


44. 


4 1/5-2 2/7 = 


30. 


6 3/9-3 1/3 = 


38. 


1 2/5 - 4/9 = 


32. 


4 1/6 - 1A2 = 


45. 


6 1/6-3 2/4 = 


33. 


3 1/5 - 2/10 = 


46. 


2 1/3 - 2/5 = 


5. 


3/6 - 1/6 = 


47. 


7 3/6 - 3/4 = 


25. 


5/12 - 1/6 = 


40. 


I 3A8 - 3/9 = 


26. 


2/5 - 2/10 = 


34. 


5 3/5 - 3/9 = 


27. 


6/9 - 1/2 = ' 


42. 


1 6/9 - 4/5 = Ctost Difficult) 


23. 


3/4 - 3/6 = 






1 


J 
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